When using Linear Deconvolution (LD) algorithm in the selection process, endmembers subset has similar endmembers and similar endmembers have an impact on the accuracy of spectral unmixing,a hyperspectral unmixing optimization algorithm based on per-pixel optimal endmember selection named Spectral Information Divergence (SID) and Spectral Angle Mapping (SAM) was proposed. At the end of the second choice, the method adopted Spectral Information Divergence mixed with Spectral Angle (SID-SA) rule as the most similar endmember selection criteria, removed the similar endmembers and reduced the effect of the accuracy by spectral unmixing. The experiment results show that hyperspectral unmixing optimization algorithm based on SID and SAM makes Root Mean Square Error (RMSE) of reconstruction images be reduced to 0.0104. This method improves the accuracy of endmember selection in comparison with traditional method, reduces abundance estimation error and error distributes more evenly.